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Abstract 

A polynomial that is nonnegative over a given interval is called a positive 
polynomial. The set of such positive polynomials forms a closed convex cone 
K. In this paper, we consider the likelihood ratio test for the hypothesis 
of positivity that the estimand polynomial regression is a positive poly- 
nomial. By considering hierarchical hypotheses including the hypothesis of 
positivity, we define nested likelihood ratio tests, and derive their null distri- 
butions as mixtures of chi-square distributions by using the volume-of-tube 
method. The mixing probabilities are obtained by utilizing the parame- 
terizations for the cone K and its dual provided in the framework of the 
Tchebycheff systems when the degree of polynomials is up to 4. Moreover, 
we propose the associated simultaneous confidence bound for polynomial 
regression curves. Regarding computation, we demonstrate that symmetric 
cone programming is useful to obtain the test statistics. 

Key words: chi-bar square distribution, moment cone, positive polynomial 
cone, repeated measurements, symmetric cone programming, Tchebycheff 
system. 



1 Introduction 

Consider the polynomial regression model of degree n (> 1): 

n 

Vh = fith, c) + Bh, fit; c) = = ^ ^ ^' (^•^) 
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h = 1, . . . ,N, where ip(t) = i^nit) = (1, t, . . . , t"')'^ and c = (cq, ci, . . . , Cn)~^ are 
column vectors in R"+^. The errors Eh are independently distributed according 
to the normal distribution A^(0, o"^) with mean and variance cr^. T C M is the 
region of the explanatory variable t where the model (11. ip is defined. Typically, T 
is a bounded interval in M. We assume that sufficient statistics of the model f ll.ip . 
that is, the ordinary least square estimator c~ of c, and when is unknown, the 
unbiased variance estimator of distributed independently of c" are available. 
In this paper, we deal with the hypothesis of positivity, or of superiority: 



/(t;c)>0 foralHeT. 



:i.2) 



To state its statistical meaning, it is natural to consider a two-sample problem. 
Let /(t;C(j)) = cjj^ipi^t) (j = 0,1) be the polynomial regression curves of two 
groups. The hypothesis that the polynomial curve of group 1 is always bounded 
below by, or superior to, group is expressed as f(t; C(i)) > f(t; C(o)) for all t eT. 
Taking the difference, we see that (11. 2p stands for the hypothesis of superiority. 
It is also possible to model the difference of two profiles (mean vectors) by a 
polynomial without modeling profile of each group (see Section . This notion 
of superiori t y is p articularly important in statistical tests for assessing new drugs 
dhiu. et al.l (120091 )1 

The set of coefficients c satisfying ( 11. 2p forms a closed convex cone: 



K = K^ = [ce M"+^ I c^iljit) >o,yte T}. 



[1.3) 



This is referred to as the cone of positive polynomials ( iBarvinokl ( l2002l )). K is 
closed, since K = HiGTl'^ I c^i^it) > 0} is the intersection of closed sets. The 
hypothesis (II. 2p is rewritten as c G K. Including this hypothesis, we consider the 
following hierarchical hypotheses: 



Hn 



0, Hi : c & Kn, and H2 : c E 



Dft+l 



[c is unrestricted). 



:i.4) 



We then formalize the test for positivity as the likelihood ratio test (LRT) for 
testing Hi against i?2- In addition, we define an LRT for testing Hq against 
Hi. In the context of the two-sample problem, this is the test for the equality of 
two regression curves against the hypothesis of superiority. As we see later, it is 
mathematically convenient to treat the two LRTs at a time. 

The theory of LRTs for convex cone hypotheses has be en developed under the 
name of order restricted inference (iRobertson. et al.l ( 119881 ) ) . The general theorem 
states that th e null distribut ion of LRT statistics is a finite mixture of chi-square 
distributions ( IShapird (Il988[ )). When the cone has piecewise smooth boundaries. 
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Takemura and Kurikil ( 119971 . 120021 ) proved that the weights (mixing probabihties) 



are expressed in terms of curvature measures on boundari es. This methodology 



i s call ed the volume-of-tube method. Using this method, iKuriki and Takemura 



(I2OOOI ) gave the weights associated with the cone of nonnegative definite matrices. 
However, the weights of few cones are obtained explicitly. 

The main result of the present paper is the derivation of the weights associated 
with the cone of positive polynomials K, that is, the null distribution of the LRT 
for positivity. By applying the representation (parameterization) theorem for the 
positive polynomial c one and its dual co n e dev eloped in the framework of the 



Tchebycheff systems (IKarlin and StuddenI (119661 )). we evaluate the all weights of 



the two highest degrees (w„+i,w„) and the two lowest degrees (wo,w„). In terms 
of these weights, the null distributions of the LRTs are expressed when the degree 
n of the polynomial regression is less than or equal to 4. When the degree n is 
more than 4, the upper and lower bounds for the null distributions are provided. 

The outline of the paper is as follows. In Section [2|, we present the expressions 
of the LRT statistics in both cases where the variance cx^ is known and unknown. 
As in most statistical tests, we can also propose (simultaneous) confidence bands 
associated with the LRT for positivity. In Section |3l we first briefly summarize 
the volume-of-tube method. In order to apply this method, we need the volumes 
of the cone K, its dual cone, and their boundaries. Modifying the representation 
theorems for the positive polynomials in the Tchebycheff systems, we obtain ex- 
plicit formulas for the weights. In Section HI we discuss the computational aspects. 
To construct our LRT statistics, we need the maximum likelihood estimate (MLE) 
/(t;Cft-), say, under the hypothesis of positivity. The coefficient ck is calculated 
as the orthogonal projection of c onto the positive polynomial cone K. We show 
that this calculation can be conducted by symmetric cone programming, which 
is extensively studied in the optimization community. We also demonstrate an 
example of growth curve data analysis. 

Throughout the paper, we treat only the polynomial regression. However, a 
polynomial is just one example of the Tchebycheff systems. The approach devel- 
oped here is applicable to other systems. Another typical example is trigonometric 
regression 

n/2 

fie;c) = co + ^{c2i-icos(i^) + C2iSin(z0)}, OeOC [0,2%), 
1=1 

and we can consider the testing problem for the positivity once more. In this case, 
by changing a variable t = tan(^/2), all results in the polynomial regression are 
translated into the trigonometric regression. 
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2 Likelihood ratio tests and confidence bands 



2.1 Likelihood ratio test statistics 

Throughout the paper, we need to deal with a metric hnear space and its dual 
space simultaneously. We write the inner product and the norm as 

{x,y)Q = x'^Qy, \\x\\q = sj (x,x)q, 

where Q is a positive definite matrix. The orthogonal projection of x onto the set 
A with respect to the distance || ||q is denoted by 

IIq{x\A) = argmin \\x - yWq. 

This is well defined when A is a closed convex set. The subscript Q in ( , )q, || ||q, 
and IIq will be omitted when it does not cause any confusion. 

In the regression model (11. ip with o"^ known, the least square statistic c is the 
sufficient statistic, and we can restrict our attention to the inference based on a 
The distribution of c is the {n + l)-dimensional normal distribution A^„+i(c, S) 
with mean vector c and covariance matrix S, where S = ct^Sq with Sq = 
(X^iLi 5 ^he inverse of the design matrix. When cr^ is unknown, 

the sufficient statistic is the pair (c, a^), where is the unbiased estimator of 
calculated from the residuals, and is distributed proportionally to the chi-square 
distribution with u = N — n — 1 degrees of freedom. 

Given the data c distributed as the normal distribution A^„+i(c, S) with S = 
(T^Sq known, the MLE of c under the hypothesis of positivity Hi : c & K is the 
orthogonal projection 'ck of onto the cone K under the metric ( , )s-i- When 
0"^ is unknown, the MLE is the orthogonal projection onto K under the metric 
(, )g-i, S = a^Sg. This MLE is the same as that with S known, because the 
orthogonal projection onto a cone is invariant with respect to the scale change of 
metric { , )q { , )kQ {k > 0). The MLEs of c under Hq and H2 are given as 
and c', respectively. Acknowledging these facts, we obtain the LRT statistics as 
follows. 

Proposition 2.1. When the variance o"^ is known, the LRT statistics for Hq 
against Hi, and for Hi against H2 are given by 

Aoi = I|ck-|||-i and A12 = ||cl||-i - ||ci^|||-i, (2.1) 
respectively, where ck = ^t.-^^K) . 
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When the variance o"^ is unknown and an independent and unbiased estimator 
of with v degrees oj freedom is available, the LRT statistics for Hq against 
Hi, and for Hi against H2 are given by 

/3oi = = ''J^" ^JVh ^ (2-2) 

respectively, where S = a^So, ck = ng_i(cli^'). 

The null hypotheses are rejected when the LRT statistics are greater than crit- 
ical points. 

The hypothesis of positivity Hi is a composite hypothesis. To obtain the 
critical points for testing such a hypothesis, we need to know the least favorable 
config uration. The proof of th e following proposition is essentially given in Section 



2.3 of [Robertson, et all (Il988f l. 



Proposition 2.2. In both cases where a'^ is known or unknown, the least favorable 
configurations of the LRTs for testing Hi (the hypothesis of positivity) against H2 
(the no-restriction hypothesis) are given by the case where Hq holds, that is, c = 0. 

Proof. In the case where cr^ is known, the acceptance region is of the form 

A = |x G I min ||x - y\\ < 

We first prove the monotonicity of the set A: 

A — c = {x — c\xeA}^A for any c E K. 
This is because, for c E K, 

A — c = <x — c \ min \\x — v\\ < d> 
= < X I min llx + c — -wll < d> 

I y&K M J 

= Ix \ min llx — vll < d > 3 < X I min llx — y\\ < d> = A. 

The last inclusion follows from K C K — c, because K is a convex cone. Therefore, 

for X~iV„+i(c,S), 

P{X eA\c)= P{X + cEA\c = 0) 

= P{X eA-c\c = 0)> P{X eA\c = 0), 
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and infj^, P(X e A \ c) = Pho{X e A) follows. 

In the case where cr^ is unknown, the LRT statistic /3i2 in (12. 2p is rewritten as 

. mu-\\cK\\u _ 

which is monotone in A12 in (12. ip . The monotonicity of the acceptance region can 
be proved similarly. □ 



2.2 Simultaneous confidence bounds 



In regression analysis, simultaneous confidence bounds for the estimated regression 
curve are often provided to assess the reliability of the estimated regression curve. 
The construction of co nfidence ba nds is still an active research topic because of its 
practical importance f Liul ( 2010 )). In this subsection, we propose simultaneous 
confidence bands that are naturally linked to our proposed LRTs. 

In general, when we want to construct simultaneous confidence bands for 
the regression curve {/(t;c) | t G T}, we need to bound \f(t;c) — /(t;c)| = 
\{c — 'c)'^tlj{t)\ above by a pivotal statistic whose distribution is independent of 
the true parameters. The most standard tool to obtain the upper bound is the 
Cauchy-Schwarz inequality. However, in this inequality, strict equality is attained 
when and only when (the closure of) the set of undirected rays spanned by the 
explanatory variable vectors {aipit) | t G T, a G M} forms the whole space. In 
our polynomial regressio n model (11.11). this becomes t he whole space W^~^^ only 
when n = 1 and T = M ( Working and Hotelling ( 19291 )). The cases where n > 2 
or T is a proper subs et of 
in limited cases 



(e.g., 



(T C. 



are not easy problems and have b een solved 



Uusipaikkal (Il983r ). IWvnn and Bloomfieldl (Il97ir )l 



In our proposal, we relax the set of estimands from the regression curve itself. 
Let ii{dt) be a nonnegative measure on T C M, and write ^{ip] = Jrpip{t) fi{dt). 
Then, filip] G K*, where 



K* = K* 



I /i(rft) > 0} 



(2.3) 



is the closure of the conic hull of the trajectory {ijit) | t G T}. This cone is the 
dual cone of t he positiv e poly nomial cone K in ( II. 3p . and is referred to as the 
moment cone ( iBarvinokl (120021 )). We construct the confidence bands on the basis 
of the inequality 



/i[/c] -M/c] = / {c-cym^dt) = {T.-\c-c),ii 



< 



\li^{j:-\c-c)\K* 



(2.4) 
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where /i[/c] = f f(t; c) jj,{dt). The equahty in (12 ■4p holds for some /x if and only if 
c — c ^ —K \ {0}, where K is the positive polynomial cone in (11. 3p . 

The statistics ||ns(S~^(c — c)|-ft'*)||^ in (12 ■4p is distributed independently of 
the true parameter c. Moreover, it is rewritten as 

^-1 





— min 1 







c- c 



|2 

Is 



c — c 



|2 



mm \\c — c — y 

yeT.K*" 



i2 

Is-i 



ns-i(c- c\T.K' 



|2 



C — C 



|ns-i(c-c|K)| 



which has the same distribution as A12 in (12.11) under Hq : c = Using the 
upper a percentile \i2,a of the distribution of A12 under Hq, we obtain the 1 — a 
simultaneous confidence bands as follows. 

Proposition 2.3. The statement below holds with probability 1 — a: 

/i[/c] G [jJ'lfc] — a/Aiv* lls; 00) for all nonnegative measure jj on T. 

Considering a particular subclass of the nonnegative measures, we obtain var- 
ious 1 — a simultaneous confidence bands. For example. 



/(t,c)G (/(t,c)- 



2, 00) for all t E T, 



and 



/ fit,c)dte([ fit,c)dt-,/X^, 



ip{t) dt 



to 



00 I for all t G T 



hold with probabilities more than or equal to 1 — a. 

When 0"^ is unknown but its unbiased estimator with u = N — n — 1 
degrees of freedom is available, we can obtain the simultaneous confidence bands 
by replacing || ||s with || ||g (E = a^Eo), and Xu^a with A'j^g.a; where A'^2,a the 
upper a quantile of the distribution of Ai2/-\/i, s xl/^- 



3 Null distributions of the LRT statistics 
3.1 The volume-of-tube method 

In this subsection, we briefly summarize the volume-of-tube method. 

Historically, the distributions of the orthogonal projection of a zero-mean 
Gaussian random vector have been well studied, since they appear as the null 
distribution of the test statistic in an order restricted inference. From the general 
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theory, the statistics Aqi and A 12 in (12. ip under the null hypothesis Hq : c = 
have the following distribution: 

n+1 

Pho(Aoi > a, A12 >b) = Y,^^G^{a)Gn+l-i{b), (3.1) 



where Gi is the upper probability of the chi-square distribution with i degrees of 
freedom. Note that Go(a) = 1 (a < 0), (a > 0). In addition, the distribution of 
the LRTs /3oi and /3i2 in (12. 2 p under Hq is expressed as follows: 

n+1 

Phq{Poi > a, /3i2 >b) = WiB^ n+i-i+^ (a)B n+i-i ^^.(b), (3.2) 

1=0 

where is the upper probability of the beta distribution with parameter (a, b). 

Note that the coefficients Wi appearing in (13. 2p are the same as those in (13. ip . 
They are nonnegative and satisfy '^^Wi = 1. This means that the distributions 
of (Aoi,Ai2) and (/5oi,/9i2) are finite mixture distributions with the same weights 
{wi}. The marginal distributions of Aqi, A12, /3oi, /3i2 can be obtained just by 
letting a = — ooor6 = — 00. The finite mixture distribution of the chi-square dis- 
tributions in (13.11) is sora e times referred to as the chi-bar-square (x^) distribution 
feobertson. et al.l JlQSsI ). Ishapirol JlQSsI )). 

When the cone Kn in (ll.4p is polyhedral, that is, a finite intersection of half 
spaces, the weights {wi} can be underst o od in terms of the internal and external 
angles of each face of the c one (IWvnru (119751)'). Moreover, in the general case 
where Kn is not polyhedral, iTakemura and Kurikil ( 1l997l . 120021 1 proved that the 
weights {wi} are expressed as integrals of elementary symmetric polynomials of 
principle curvatures of the boundaries of the cone Kn- These integrals are not easy 
to handle in general. However, the weights of the two highest degrees and two 
lowest degrees, Wn+i,Wn,wo and wi, have relatively simple expressions as follows: 

Voi„(is:n§") Voi„_i(9fs:n§") 



w. 



n+1 



Vol! 



Wi 



^n+l 

_^{dK* n (^ 



Wr, 



Wo 



2 fin 

Vo\l{K* n (§" 



n 



where dK and dK* are the boundaries of K and K* 



pn+l 



\X\ 



n+1 



pn+1 



(3.3) 



1} 



1}, (§")* = {a; G 

are the unit spheres, Vol^ and Vol^ are d-dimensional volumes induced by the 
metrics (, and (, )s, respectively, and 

27r'^/2 



Tid/2) 
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is the volume of the {d— l)-dimensional unit sphere in R"^. The lower dimensional 
measure is induced by t he metric of th e ambient space It is also defined as 

the Hausdorff measure (IFedererl (Il996l )). 

Moreover, a useful relation is known as a consequence of the Gauss-Bonnet 
theorem: ^ 

J2w.= J2^^ = 7^- (3-4) 



j:odd 



The distribution of /3oi with z/ = is interpreted as the volume formula of a 
spherical tubular neighborhood as below. Let M = fl S" be the intersection of 
the cone K in (11 .Sp and the unit sphere. Define the spherical tube about M with 
the radius 6: 

Tube(M, 6') = < a; G | min dist(x, y) <0\, dist(x,?/) = cos''^{x,y). 
Then, because 



A 



01 



> cos^ e ^ — e Tube(M, 
c] 



and c/\\c\\ is distributed uniformly on under Hq, we see that 



Vol„(Tube(M,^)) 
Vol„(§") 



n+l 
i=0 



hl;zl(C0S^ 9). 



This is the reason why our methodology is called the tube method. 

The volume-of-tube method has been developed as a tool for approximat- 
i ng the tail probability of the maxi r aum of a general Gauss i an ra ndom field 
jKnowles and Siegmundl Jl989h . Q fll993h . kdler and Tavloil toO^ ). This is 
regarded as a generalization of th e distribution of the pr o jectio n length of a Gaus- 
sian vector onto a convex cone (Kuriki and Takemura (2001)). This method is 



also used for the construction of confidence bands 



prehensive survey, see lKuriki and Takemura! (120091 ). 



NaimanI (1l990l ) ) . For the com- 



3.2 Representations for the cones K and K* 

In order to evaluate the volumes in (13.31) . we need to introduce "local coordinates" 
of the cones K in (II. 3p . K* in (12. 3p . and their boundaries dK and dK*. This is 
actually possible by means of the representations in the theory of Tchebycheff sys- 
tems. We consider the following three cases separately: (i) T = [a,b] (bounded), 
(ii) T = [a, oo), and (iii) T = (— oo, oo). 
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The two propositions below give presentations for the moment cone K* and 
its boundary dK*. Let 



Mi) 



\t\ < oo) 



_(0,...,0,(±1)")T it = ±oo) 
Let M+ = (0, oo), and 

= A„(T) = {r = (n, . . . , r^) G (int T)™ | n < ■ • ■ < r„}. (3.5) 
Let Aq = formally. 

Proposition 3.1. The moment cone K* on (i) T = [a,b], (ii) T = [a, oo), 
or (in) T = (—00,00) (when n = 2m is even) has the following almost sure 
representations. Let a = —00 when T = (—00, 00), and b = 00 when T = [a, 00) 
or (—00, 00). 



K* - 6^^^ , 



X Ar„- 



X Aj„+r 



(3.6) 



almost surely with respect to the (n + 1)- dimensional Lebesgue measure, where 

■ m 

^Pi^n(Ti) + Pm+lM^) = 2m), 

i=l 

m 

PiV^„(a) + ^Pi+i^„(ri) + Pm+2^n(&) {I = 2m + 1), 



(3.7) 



PlV'n(a) + ^Pj+lV'n(Ti) (/ = 2m), 
i=l 

m+1 

^Pi^n(Ti) (/ = 2m+l) 



(3.8) 



I, i=i 



The maps and (pi^^l in /I3.6i) are diffeomorphic. 

Remark 3.1. The representations with jj^S. 7| ) and liS. 8\) are called the upper and 
lower representations, res yectively. They are c o incide nt when T = (—00, 00) and 
n = 2m (Definition 3.2 o uKarlin and Studden ll96a) . Section 3 of Chapter II). 

Remark 3.2. When n = 1, 0i^2(p, r) is piipi{a) + p2ipi{b) , which does not contain 

the argument t. In \3. 6\) . (t)^n,l{^+^ x A^„j) = 0^^^(]R^ x 0) should read as 

{01? (P?'^) I P ^ ^+}- '^^^ ^^^'^ convention in Propositions \3. IV 3.4 ■ 
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Proof. The representations of the right-hand sides of (13. 6p for T = [a,b], [a, oo), 
and (—00,00) are provided in Section 3 of Chapte r II, S ection 4 of Chapter V, 



and Section 2 of Chapter VI of iKarlin and StuddenI (Il966l ). respectively. The last 



case of T = (—00, 00) is stated in terms of periodic functions. Each of the upper 
and lower representations is the unique representation when pi > for all i, and 
all of a, r,- and b are distinct. 



Although the representations given by lKarlin and StuddenI (|1966[ ) include the 
cases where Pi = for some i, and some of a, and b take the same value, we 
can ignore them because the images of the maps (p^n^l and in such cases are 
{n — l)-dimensional. 

The maps (f)^n and 01^2 are one-to-one and obviously differential, that is, 
diffeomorphic. □ 

Proposition 3.2. Suppose that n > 2. Let be defined in i\3.5\) . Let ipf^^ and 

0^^/ be defined in ( [g. ?| j and \3.^) . The boundary of the moment cone dK* has the 
following almost sure representation. Let again a = inf T and b = supT. 
(i), (a) WhenT=[a,b] or [a, 00), 



(Hi) when T = (00, 00) and n = 2m is even, 

9if:=0£_ifM™x A™) (3.10) 



almost surely with respect to the n-dimensional HausdorfJ measure, where U means 
a disjoint union. The maps (f)^n,n-i ^'^^ '^rtl-i and l[3.1U\) are diffeomor- 

phic. 

Proof. The general forms of the one-to-one representations for T = [a, b], [a, 00), 
and (—00, 00) are provided in Section 2 of Chapter II, Section 4 of Chapter V, and 
Section 5 of Chapter VI, respectively. The last case of T = (—00, 00) is stated in 
terms of periodic functions. Picking up the terms whose images are n-dimensional, 
we have (13. 9 p and (I3.10p . The second component in (13. 9 p disappears in (I3.10p 
because when T = (—00, 00) and n = 2m, ipni^i) = i^nib) = (0, . . . , 0, 1)^. □ 

The following two propositions give representations for the positive polynomial 
cone Kn and its boundary dKn- 
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Proposition 3.3. The positive polynomial cone Kn has the following almost sure 
representation: 

almost surely with respect to the (n+ 1)- dimensional Lebesgue measure. Here, the 
function 7) G IR"^-'^ with a = (01,02) G R\ and 7 = (71, . . . ,7^-1) G A„_i 

is the coefficient vector of the polynomial pnit; 0,7) = V2n(a, 7)^^n(^) in t defined 
below: 

(i) WhenT= [a,b], 



m—1 



ai 



Hit - l2j-if + «2(t -ci){b-t)\[{t- -i2,f {n = 2m), 



aiit - a) Wit - 72,)' + 02(6 - t) Wit - -i2j-if in = 2m + 1), 



(a) when T = [a, 00), 



Pnit; a, -f) 



m—1 



Wit - 72,-1)' + «2(t - a) n - ^2,)' = 2m), 



i(t - a) JJ(t - 72,-)' + as - ^2j-i)' = 2m + 1), 



m— 1 



(^m^ w/ien T = (—00, 00) and n = 2m, 

m 

Pnit; a, 7) = tti - 72j-l)^ + "2 JJ ~ ^2j)^- 

The map (pn is a diffeomorphism. Here, we use the convention Y^j=i — 1- 

Proof. The representations of the positive polynomials on T = [a, 6], [a, 00), and 
(—00, 00) whose orders are exactly n are provided i n Section 10 of Chapter I I, 
Section 9 of Chapter V, and Section 9 of Chapter VI of iKarlin and StuddenI ( 119661 ) . 
respectively. They are unique representations when ai > and 0^2 > 0. 

Because the contributions of the positive polynomials of order n with ai = 
or 0^2 = and the positive polynomials of order less than n are n-dimensional at 
most, we do not need to take them into account. 

The uniqueness of the representation of p„ implies that the map <^n is one-to- 
one. It is obviously differentiable and hence diffeomorphic. □ 
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Proposition 3.4. Suppose that n > 2. The boundary of the positive polyno- 
mial cone dKn has the almost sure representation below. Define the functions 
(^i*^(a,7,7) G R"+^ with n - i > 1, a e R^, 7 G A„_i_j, and ^ e R, by the 
coefficient vectors of polynomials as 

{t-jypn.,{t-a,j) = <^»(«,7,7)^^n(t) {^ = 1,2). 

Define the function (p^2\'^i->'l) ^ ^1 ^ ^+ ^'^^ 7 G M 6y t/ie coefficient 

vector of a polynomial as 

{t-^fxa,^<p?\ainyMt)- 



(i) When T = [a,b], 



(a) when T — [a, 00), 



' cp^^Uml X An-3 X (n>3), 
U (^W (rI X An-2, a) 

u{-v9«(r^x A„_2,fo)}, (3.11) 



(n > 3), 
(n = 2) 




U<^„_i(^M^ X A„_2j, (3.12) 
(Hi) when T — (—00, 00) and n — 2m is even, 

'v^^f^te X A„_3 xt) (n>3), ^ ^ 



(^f)(M+xr) (n = 2) 



almost surely with respect to the n-dimensional H aus dor ff measure, where U means 
a disjoint union. The maps Lpn, Vn\--,ci), Vn\-,b), and ^pn^ are diffeomorphisms. 

Proof, (i) The case of T = [a,b]. The boundary of the positive polynomial cone 
Kn is proved to consist of the positive polynomials of order n (at most) that 
have zeros on T. For the almost sure representation, we need only polynomials 
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of the highest degree. Hence, we can consider only the following three types: 
(t-7)2p„_2(t;a,7) (7 ^ intT), (t - a)p„_i(t; a, 7), and (6 - t)p„_i(t; a, 7) with 
ai,a2 > 0. The above three types have no intersection, and (13. lip follows. 

(ii) The case of T = [a, 00). The boundary of the positive polynomial cone Kn 
is proved to consist of the positive polynomials of order n (at most) that have zeros 
on T and the positive polynomials of order n — 1 (at most). For the almost sure 
representation, we can consider only the following three types: (t — 7)^Pn-2(^; 7) 
(7 G intT), (t — a)p„_i(t; a, 7), and Pn-i(t; a,'j) with ai,a2 > 0. These three 
types have no intersection, and (13.121) follows. 

(iii) The case of T = (—00, 00). The boundary of the positive polynomial cone 
Kn is proved to consist of the positive polynomials of order n (at most) that have 
zeros on T and the positive polynomials of order n — 2 (at most). For the almost 
sure representation, we can consider only the case (t — 7)^p„_2(t; a, 7) (7 G T), 
and flXT^ follows. □ 



3.3 Volume formulas and the weights 

The diffeomorphic maps appearing in Propositions I3.1H3.4I are homogeneous func- 
tions with respect to their first arguments p and a. Therefore, by restricting the 
length of the first argument, we can construct almost sure representations for the 
intersections with the unit sphere. For example, (f)^n{rp,T) = r(f)il^n{p,T) for a 
constant r > 0, and we have 



a. s. , 



where 

and 

Define 



€,hp,r) = <p'^^J{p,r)/U^^J{p,T)h, 
§T = {p = (pO e 1 5^p^ ^ 1, > 0}. (3.14) 

4>i'jip,r) = ^i':hp,r)/\\4>l']{p,r)U 

<^n(a,7) = <^n(a,7)/ll<^n(a,7)l|s-i, 
^»(a,7,7) = ^«(«,7,7)/llv^i^n«,7,7)l|E-i (^ = 1,2), 

similarly. 

In the proposition below, let 9 = {9i) E Qm be the local coordinates of in 
daHD. For example, p = p{e) = (^1, . . . , y^T^^^9f) ,9 ee„^ = W]^. Another 
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example is the polar coordinates p{0) = {piiO)) G 6m = (0,7r/2)™ with pi{9) = 
cos 611, pi{9) = YY~}^ sin 9 j cos 9 i (j = 2, ...,m), and Pm+ii9) = YY^^^sm9j. 

Proposition 3.5. Let ^ = {9,t) and = Yl^^iYl^'^i Lebesgue mea- 

sure, may consist of either 9 or t only when the other does not appear in the 
integrand.) Write p = p{9) for simplicity. 

Vor(/cn(ST)= [ 6et{(?^^)\(?^lf^)y d( 

i^^^^ H^^jj 

and when n >2, 

Vor(9A^:n (§")*) 




{if T = [a, b] or [a, oo)). (3.15) 
The second term in the right-hand side of 1^3. 15\) is not needed when T = (— oo, oo). 

Proposition 3.6. Let ( = {9, 7, 7) and d( = d9Y[ d'^i drj be the Lebesgue measure. 
(Some of 9,'y,^ may not be included in ( if they do not appear in the integrand.) 
Let a = (cos 6*, sin 6'). 
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and when n >2, 
Vol{dKn n §") 



det 



(0,|)xA„_3xT 



1,^(2)/ 



+ 



det 



(0,f)xA„_2 



i(0,f)xA„_2 I V f^C, / 



d(fn\a,'j,a) 
d'Pn'{a,'y,b) 



dC (n>3), 
(n = 2) 



dC 



+ 



det 



(0,f )xA„_2 



dC 

g<^n-l(Q,7) 



'if T = [a,b] or [a, 00)) 



;z/T=[a,6]) 
if T = [a, cx))). 



(3.16) 



/n i/ie right-hand side of Ii3.16\) . the second term is not needed for T = (—00, 00), 
the third term is not needed for T = [a, 00) and (—00, 00), the fourth term is not 
needed for T = [a, b] and (—00, 00). 

Substituting the volumes obtained in Propositions 13.51 and 13.61 into (13. 3p , we 
get Wn+i, Wn, wq, and wi. Combined with the Gauss-Bonnet theorem (13. 4p . all 
weights {wi} for n < A are obtained as follows. 

' {wo, \.\- Wo) = (i - «^n+l, |, U^n+l) = 1), 

(i - w;„,wi,w;„, i - wi) (^^ = 2), 

^ (wO, Wi, \ -WQ-Wn,\-Wx- Wn+i) (^ = 4). 

For n > 4, some of the weights are undetermined. However, thanks to the 
Gauss-Bonnet theorem (13. 4p . and noting that Gi[a) and Bi^ (g) are in- 

creasing in i, and that (5ji+i_j(6) and B n+i-i 1^(6) are decreasing in z, we have 
upper and lower bounds for the marginal distributions of (13. ip and (13. 2p . For 



[Wo, 



Uln+l) 
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example, the bounds for Aqi and A12 are given by 

n+1 n+1 



^MjGi(a) < Pffo(Aoi > a) < ^^ViGiia). 

i=0 i=0 

n+1 

^ViGn+i-iia) < Pff„(Ai2 >a)< "^UiGn+i- 



n+1 



i=0 



where 



{Uo, . . . ,Mn+l) 

[wq, Wi, ^-Wq- Wn+1, I - Wi - Wn,0, . . . ,0, Wn, Wn+l) : odd), 



n— 4 



(wq, Wi, I - Wo - Wn, I - Wi - Wn+i, 0, . . . , 0, Wn, Wn+i) {u : even), 



n-4 



(fO, . . ■,Vn+l) 

✓ 

[wq, Wi,f), . . . - Wi - Wn, \ - Wq - Wn+l, Wn, Wn+l) {u : odd). 



n-4 



(wo, Wi,Q, . . . - Wq - Wn, \ - Wi - Wn+l, Wn, Wn+l) {n : even). 



n-4 



Moreover, since Gi{a) = o{Gn+i{a)) as a — )■ 00 for i < n + 1, the tail proba- 
bilities of Aoi and A12 have asymptotic expressions 

-Pf/o(Aoi > a) ~ Wn+iGn+i{a), Pho{^i2 > a) ~ woG'„+i(a) 
as a — )■ 00. 



4 Computational aspects 

4.1 A numerical procedure for MLE 

To obtain the LRT statistics Aqi and A12 in fl2.1l) . we need to perform the or- 
thogonal projection onto the positive polynomial cone K. For this purpose, the 
following symmetric cone programming technique is useful. In this subsection, we 
treat only the case of T = [a, h] with finite a, b. However, the technique explained 
here is easily extended to the other cases. 

The positive polynomial Pnit) of degree n on the set T is characterized in 
Proposition 13.31 This is a unique representation. Admitting the redundancy of 
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the parameters, this polynomial is rewritten as 



Pn(t) 



n = 2m), 

[n = 2m + 1), 
(4.1) 

where Qi and Q2 are symmetric positive semi-definite matrices. This polynomial 
(14. ip is obviously nonnegative on T = [a,b]. Conversely, the polynomial Pn{t) in 
Proposition 13.31 can be written as (14. 1|). This repres entation is sometimes referred 
to as the Markov-Lukacs theorem (INesterovl (I2OOOI )). 

By arranging the terms, the polynomial Pn{t) in (14. ip can be written as Pn{t) = 
e(Qi, Q2Y ''Pnif)^ where e(Qi, Q2) is a (n+l)-dimensional column vector depending 
on Qi and Q2- Using this representation, the orthogonal projection of a given 
vector c onto the positive polynomial cone K is formalized as the optimization 
problem below: 



maximize —d 

subject to (i > ||c~— c||e-i (quadratic cone restriction) 

c = e{Qi, Q2) (linear restriction) 

Qi,Q2 ^ (PSD cone restriction) 

This is an optimization problem with quadratic cone, linear, and positive semi- 
definite (PSD) cone restrictions. This can be solved in the framework of symmetric 
cone p rogramming. Several public softwares are available (e.g., SeDuMi by [Sturm 
fllQQok 

Figure HH] shows an example of orthogonal projection. Let K be the positive 
polynomial cone of order n = 3 on the set T = [a, 6] = [0, 1]. Under the metric 
II ||s-iwithS = ((i + j — l)^^)-,^^. the orthogonal projection of/(t;c) = O.St — 
1.5t2 + 13 onto K is given by fit^^K) = 0.0258 + 0.5151t - 1.4891^^ + 1.0086t^ In 

Figure urn f(t;c) is depicted as a dashed line ( ), and the projection f(t;cK) 

is depicted solid line ( ). 



4.2 Analysis of growth curve data: An example 



In this subsection, we analyze growth curve data cited in lPotthoff and RoyI ( 119641 ). 
The dataset consists of a certain measurement on dental study for 11 girls and 16 
boys at ages 8, 10, 12, and 14 years. 

In our study, let t be the age minus 11 for stabilizing numerical calculations. 
The measurements of the individual h at the age t + 11 in the girl and boy groups 
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Figure 4.1: Projection onto the positive polynomial cone 



are denoted by Xoht and Xiht, respectively. For modeling the difference of the 
profiles (mean vectors) of two groups, we assume the multivariate normal model: 



XQht — fJ't + £oth, h — 1, 
xiht = IJ't + fit; c) + euh, 



. ,no (= 11), 
/i = 1, . . . , ni 



16), 



(4.2) 



with 



fit; c) 



Co + Cit + C2t^ + Cst^, 



where Ejh = (£^j/it)te{-3, -1,1,3} (j = 0, 1) are independent Gaussian error vectors 
with mean zero. For the covariance matrices, we assume the intraclass correlation 
structure 

S, = Cov(£,-,,£,,) =r,{(l-p,)/ + p,J} (j = 0,l), (4.3) 

where J is the 4x4 matrix with all entries 1, and Tj and pj are unknown 
parameters. The model (14. 3 p is widely used covari ance structure in the ana l- 
ysis of growth curves and r e peate d measurements (ICrowder and Handl ( Il990l ). 
Kato. Yamada and Fujikoshil ( I2OIOI )). 

Under the model (14. 2 p with (14. 3p . the MLEs are calculated as 

c= (co,ci,C2,C3)^ = (2.053,0.551,0.0536,-0.0301)^, 

and To = 4.469, po = 0.868, ri = 5.147, pi = 0.479. If Sq and Si are known, c is 
distributed as the normal distribution with covariance matrix S = (F^1/-^F)-\ 
where V = ng ^So + nf^Si and F = (t*)tG{-3,-i,i,3},o<i<3 is the design matrix. The 
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MLE of E is obtained as 



/ 0.649 


-0.0173 





0.140 



-0.0157 



-0.0173 


0.00345 




-0.0157 


0.00192 1 



\ 



V 



In the following, we treat S as the true value, and suppose the statistics c to 
be a Gaussian vector with mean c and covariance matrix S as an approximating 
analysis. 

Let us focus on the whole period from ages 8 to 14 years, that is, T = [—3, 3], 
and consider the positivity on the set T. The hierarchical hypotheses in (11. 4p are 
Hq : f (t; c) = {c = 0) , Hi : f(t; c) is a positive polynomial on T (c G K), and 
H2-f(t;c) is unrestricted (c G M^). Since f(t;c) is already positive on T, the 
orthogonal projection ck is c itself, and the LRT statistic for testing Hq against 
Hi is Aoi = llcft-lll.i = ||c|||_i = 19.293. This looks highly significant because 
the p-value referring to the chi-square distribution with 4 degrees of freedom is 
already 0.000688. Actually, by means of Propositions 13.51 and 13.61 the weights for 
the distribution of Aqi are 



and the p-valne for Aqi is obtained as 0.000293. We conclude that the growth 
curve of the boy group is always beyond that of the girl group. 

Then, what about the growth rates of two groups. Is the growth rate of the 
boy group always greater than that of the girl group? In order to confirm this 
hypothesis, let us take the differential of f(t;c): 



We suppose that d is distributed as the normal distribution N^ld, ULL^), d = Lc. 
Here again, we consider the hierarchical hypotheses in (II. 4p that Ho : f'{t; c) = 
{d = 0), Hi:f'(t;c) is a positive polynomial on T (c? G K), and H2:f'(t;c) is 
unrestricted {d G M^). Since /'(-3;c) = -0.582 < < /'(0;c) = Ci, f'{t;c) is 
not a positive polynomial on T = [—3, 3]. The orthogonal projection of d onto K 
under the metric (, )(^gj^T-)-i is 



{wo,Wi,W2,W3,Wi) = (0.0072,0.0657,0.2416,0.4343,0.2512), 



f'{t;c) = Ci + 2c2t + 3c3t^ = f{t;d), 



where 



d = Lc= (0.551, 0.107, -0.0902)^, 




dx = (0.348,0.0776,-0.0128) 
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The LRT statistics for testing Hq against Hi, and for testing Hi against H2 are 
obtained as Aqi = 9.293 and A12 = 0.417, respectively. The weights are computed 
as 

{wo, wi, W2, W3) = (0.3318, 0.4792, 0.168, 0.0208). 

Using these weights, the p-values for Aqi and A12 are calculated as 0.00324 and 
0.787, respectively. Thus, the hypothesis that /' is a positive polynomial is ac- 
cepted, and the hypothesis that /' = is rejected at the 1% significance level. We 
conclude that the growth rate of the boy group is always greater that that of the 
girl group between the age 8 and 14. 
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